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® Several different methods alone or in combination can be used to reduce image jump or stutter. The image 
plane on which the original image is taken can be mechanically or electronically rotated atxjut a point of rotation 
in the scene. The number of original images which are viewed could be ir>creased by interpolation. The 
subtended viewing angle of the viewpoints can be reduced and viewpoints within the subtended viewing ar>gle 
can be increased by interpolation. Reduced subtended viewing angle imagies can be created for each eye. The 
depth of focus of the images can be changed by identifying the images that jump and blurring the images 
outside the area of interest The original images can tie processed to move the image plan further back from the 
objects in the scene. Some of the images ordinarily existing bet^ 
eliminated. The objects in the background of the scer>e beir^^|^^^^ 

in the scene. The highest detail volume of the images can be ||ehSRed arid Ihe images can be proce^s^d to 
rotate around the volume. The highest detail area can be identified arid the original irna^rs processed to 
displace the images to minimize the movement of the highest^ detei^.^a^ 

and a point within each image identifi d to align the pdht from" a linear or other 

transformation. 
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Cross References to Related Applications 

The present application is related to U.S. Application entitled Electronically Interpolated Integral 
Photography System by Taylor et al. having U.S. Serial No. 07/722 J13 and Kodak Docket No. 61.496. to 
U S Application entitled Method of Modifying a Time Varying Image Sequence By Estimation of Velocity 
Vectors by Fogel having U.S. Serial No. 07/823,723 and Kodak Docket No. 61,796 and to U.S. Application 
entitled Three Dimensional Photographic Printing Method And Apparatus by Manico having U.S. Serial No. 
07/824,824 Kodak Docket No. 62,918 all of which are assigned to Eastman Kodak Co. and incorporated 
herein by reference. 

BACKGROUND OF THE INVENTION 
Field of the Invention 

75 The present invention is directed to methods and apparatus for optimizing Images with an apparent 
depth and. more particularly, to methods and apparatus which use one or a combination of several 
techniques to minimize image jump or stutter in depth images. 

Description of the Related Art 

20 

Images which have an apparent depth can be produced in a number of different ways. Images 
produced using integral, lenticular and barrier technology suffer from a problem commonly called image 
jump or stutter as the point of view of the viewer of the image shifts. This problem can be partiaJly 
understood by using Fig. 1 which shows a cross sectional view through an integral or lenticular photograph. 

25 Portions of the Images 1-4, originally photographed from different image takir>g viewpbirite, are kmn^ a 
photographic media 10. These portions of the images are projected into viewer space by a faceplate 12, 
sometimes called an overlay or faceplate, which has formed on one surface a series of cyHndrical or 
spherical refracting surfaces having a positive diopter power. The curvature of the refracting surfaces and 
the faceplate thickness is predetermined by design to establish a local lens focal length substantially equal 

30 to faceplate thickness. Therefore, images coincident with the rear surface of the faceplate will be projected 
to an infinite conjugate on the opposite side. The combination of the curved surface and the faceplate 
material could be considered as a lens or lenslet and the entire assemblage an array of lenses or leoslets. 
In the special case of lenslets formed as parallel cylinders, the lenslets are commonly called lenticules, 
therefore in the case of a lenticular photograph the images 1-4 on substrate 10 positipnecl under each lens 

35 14 are thin linear slices of the original photographs (or images captured) and the l^i^vi 4 are cylindrical. 
In the case of an integral photograph, the images 1-4 on substrate 10 are drcular pprtioro of the original 
photograplts and the lenses 14 are spherical. Because the images 1-4 formed ^^rtp^, ^^s^^ 10 are 
discrete portions of the original images, as the viewpoint of the viewers shift from Viewpoint 1 to viewpoint 
2. a transition or jump occurs tietween the images. This sudden shift makes the photograj^ seem less real. 

40 The jump problem is even more apparent when objects in the original scene are separatiBd depth wse 
by a significant distance. This further problem is illustrated and exaggerated in Fig. 2 in whid^ two objects 
16 and 18. when photographed through two cameras 20 and 22 (or a single camera with multiple lenses), 
produce tvio images 24 and 26. Between these two images 24 and 26, not only does the ppsritk^ of o^ect 
16 in the foreground move or displace toward the right a distance di. but the position of object 18 in me 

45 background displaces a different distance d2. If the viewer is viewing these images mroi^ a: lenticu or 
integral faceplate on a photograph and concentrates attention on the object 16, for e^pte a^^^n. whw 
the view jumps between images 24 and 26, object IB,, vyhic*^ 
experience a large'ilftsplacement or shift: This shift of objects at a distant beh^ 
point also makes the photographs seem less real. 

50 Prior art systems for capturing multiple images and creating depth images hav? Jypicalty u^ Optical 
capturing system (cam ras) and optical pwlritiriMg systerfis (enlargers with spi^^ 

not capable of moving images or portions of images relative to each other w of er^r^ between 
the actually captured images. That is. the prior art optically based systems are vinciapa^ 
image jump or stutter problem. 

55 
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SUMMARY OF THE INVENTION 

It is an object of the present invention to reduce image stutter or jump in depth images. 
It is also an object of the present invention to improve the realism of integral, barrier or lenticular 
5 photographs. 

It is also an object of the present invention to improve view or angular resolution. 
The above objects can be attained by using several different methods atone or in combination to 
reduce image jump or stutter. The image plane on which the original image is taken can be mechanically or 
electronically rotated at>out an arbitrary point of rotation which can be located t)etween the foreground and 

10 background objects or on one of the objects. This keeps the rotation point centrally located in the views and 
reduces the distance which objects in the scene appear to move relative to each other from viewpoint to 
viewpoint. The numt>er of images which are viewed could be increased from the original set of images by 
interpolation- This increases the number of viewpoints and reduces the displacement of objects in the 
image from viewpoint to viewpoint. The subtended viewing angle of the viewpoints can be reduced and the 

75 numt>er of images and viewpoints within the subtended viewlrig-angjleican be increasedrby interpc^ 
The reduction in subtended viewing angle reduces the amourit of bverati kriage jump within itho ; viewing 
angle while the increase in the number of viewpoints within the subtended angle further^^ r^ 
displacement from viewpoint to viewpoint. The depth of focus of the original images can^be etectrcHiically 
changed by identifying the images that jump and the displacement of the jump, and then blurnr^rtlibse 

20 images outside the area of interest- The jumping of the images in the background will t>e less distracting 
since the images are not in focus. The original images can bfe processed to move the image; plane further 
back from the objects in the scene. This corresponds mechanically to moving tf>e camera further back from 
the original iscene and reduces the displacement between views. Sonrw of the images, in both the 
interpolation methods and subtended viewing angle reduction methods, ordinarily existing between the right 

25 and left eye perspectives and which would normaHy be seen if ^the 'photograph is translariSy^i^^^^^ can 
be eliminated. The remaining number of images in the left and right eyQ^pef;specttves:^can 
interpolation. This limits the preferred viewing angle of the photograph btit '^^ 

highest detail or interest area of the images can be identified and the images can be processed ;tolrota^ 
around the area of highest detail. The highest interest area can be rnade into the highest detail area by 

30 focusing on the highest interest area with a low f-stop lens during inhagfeic^^ 

detail area substantially reduces the jump of the highest detsul areaV tVyjlthflh^'htgh^^^^ 
the original images can be processed to linearly displace theiirnages, so that the movement of. ftNe^t^^ 
detail area is minimized. The original images can be viewed arid an arbitraary.: alignmeriit point wtblH^ 
image identified. The views can then t>e processed to align the ;aligfip>en^ 

35 linear or other transformation. The alignment of the particular pqjht re^u 

depth image to substantially zero and correspondingly reduces:^juirhp;fSflb«^^ objeds; r;^ : .;^?^^^^^ 

These together with other objects and advantages which Wi If :^Be$su6^^ 
details of construction and operation as more fully hereinafter described^^Kl ciaimeid. refefrence^^:^^ 
to the accompanying drawings forming a part hereof, wherein like numerals r^er to like parts throughout. 

40 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 illustrates the principles of image reproduction using lenticular or integral images; 
Rg. 2 illustrates an image jump or stutter problem; 
45 Fig. 3 depicts the hardware components of the present invention; 
Rg. 4 depiicts a p>arallel perspective axis system; 

Fig. 5 illustrates a xx^nvergent perspectt^ axis system;^;; v i , . . ti,;: ; . - ■^v 

Rgi 6 ddpiSts? subtetnded^a^ ^ a. ...-.^^^^ .^^^^ ^ ^..j, ... 

Fig. 7 illusti'ates how image jump can be reduced using a cdnvergerit.pi^^ system; 
50 Fig. 8 illustrates a process for reducing jump; 

Rg: 9 illustrai6«^a^^ : -,1-.-..^;.^ 

Fig. 10 depicts view angle ax^^ ■ - -cJi^ .. -.^^r . ^ : ^ 

Fig. 11 ilkjstrates how portions of imag s are combined into Vij^ws,--: > r.:!. 

Rgs. 12 and 13 depict viewing relationships; T . ■ V 

55 Fig. 14 illustrates angular relationships between objects in a view; 

Fig. 15 illustrates how jump can t>e reduced by adding views; 

Fig. 16 depicts another process used to reduce image jump; 

Fig. 17 illustrates how jump can be reduced by reduction of subtended angle; 
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Fig. 18 depicts another process used to reduce image jump: 
Fig. 19 depicts image displacement; 
Fig. 20 illustrates another process to reduce image jump; 
Fig. 21 illustrates the relationship used in the process of Fig. 18; and 
5 Figs. 22 and 23 depict a method of reducing jump by aligning images to a point of rotation. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention will be described with respect to producing the viewed depth image as a 

70 lenticular photograph, however, the present invention applies to integral and barrier photographs, as well as 
cathode ray tube displays with lenticular, barrier and integral overlays placed over the faceplate of the 
display. A depth image is generally a lenticular or integral or barrier display of image segments wfiich 
change with an observer's position relative to the display in such a manner that stereopsis is experienced 
by the observer. The realism of a depth image is increased if ttere are enough image segments recorded 

15 so that the ot>server's head can be moved and additional stereographic views of the scene become visible. 

The typical hardware used by the present invention to produce improved resolution depth images is 
illustrated in Fig. 3 and has three components: an image recording system 40^ an imaging processing 
system 42 arKi an image production system 44. The image recording system can be several cameras 
arrayed in a jig, a single camera slidable to different positions in a jig. or a single camera in a single 

20 position but having multiple apertures for recording different views. If the cameras are not electronic, this 
recording system would also include an image scanner for scanning the film negative produced by the 
cameras and converting the negative image into an electronic image which is provided to the image 
processing system 42. A typical image scanner would be the 35mm Photo CD Film Scanner available from 
Eastman Kodak Co. The image recording system could bypass the film to digital conversion by providing a 

25 high resolution electronic camera for recording multiple taking views of the objects being photographed. 
Once the image has been digitized, the image will be processed in accordance vyitti the. processes 
discussed later herein by a computer suitable for image processing such as the VAX 4000 avaiiat>te from 
Digital Equipment Corp. Once the processed image is producedi;it is reproduced 

system 44 which can include a light valve film writer, such as LVt Model 1620B from Eastman Kodak Co.. 

30 or a printing system as described in the related Manico application: The :reUrt|f^^^ and Manico 

applications previously mentioned describe overall systems which will take ^m^^^^ creat 
lenticular im^s and print those images on an appropriate media. ' ^ 

In a real world image, as illustrated in Fig. 4. as the position of an imager, such as the eye. a camera, 
or an electronic sensor, changes by moving horizontally in x. and provided the irn^ is maintaining a 

35 constant angle of gaze, (that is. the imager points to the same point at infinity) every element of ^ scene 
closer than infinity to the imager, will appear to proportionally shift by a distance corresponding to the 
distance from one view to the next divided by the depth distance to each respective etenr>ent. This wouW be 
equivalent to the appearance of moving any respective element horizontally in the opposite direction. When 
considering the eye as an imager, the human observer takes this perspective change for granted as (s)he 

40 moves his head laterally. This in fact, is recognized as one of the visual cues to depth perception exclusiv 
of stereopsis. For example, with the imager in position 50. viewing a central perspective axis 52. and then 
moving a distance x1 to view position 54. and viewing along penrsp^tiv© 56 (which is parallel to 52), all 
points in the scene before the imager at positions substantially closer to the irnager than infm will appear 
to have shifted a distance x1 in their respective depth planes: However, points *Hfifii^ 

45 separated from the imager, will not appear to have moved any distance in x. Slmi^rhri if the im^er th^ 
moves from view 54. to position 58. a distance of X2 from position. 50 and views, ak^^^^pective ax^ 
(whteh is parallel to 52) again, all elements in the scene will app^^fo 
X2 in their deptK^ plane exce^ those elements at infiriiiiy: jmmee vms^^m 
camera will show displacements of all objects in the view by the amounts xi afkl x2. re^^ 

50 those points in the views which are at infinity. With such ,n^€^T^nts^t^ 
and 60 are parallel, arid the trnag r (Ih eye or the carhera)^^^i6e? 

infinity. Note that the positions 50. 54 and 56 are align d in the depth or ^ dimension such as would >be 
found in a jig of three cameras or a single camera with several apertur s projectir^.^^>^ 
single piece of film. Fig! 4, when ca^meras or camera apertures are placed atvfX5Sitipns 50; 52 aixl^^^S^ 
55 depicts a conventional depth image capture technique. Typically, a camera such as tte Nishika N8000 
35mm has a separation between each of the four lenses of 18mm. 

Scenes can also be viewed or captured by rotating ifround^a point closisr than infinity, iand Fig. 5 shows 
viewing conditioris for three views where rotation is around a point a distance Zi away from the viewing 
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location 72. At the viewing locations of the eye or camera, viewing locations 70, 72, and 74, respectively, 
the perspective axes are directed toward the point 76 along paths 78, 80 and 82, respectively. In this case, 
the viewer or camera can be thought of as rotating around the point 76 a distance Zi from the viewir^ 
location 72. 

5 A window or reference frame is established by making a point on an area of highest interest remain 

stationary for all views of the subject. This point could agree with the convergent point 76. 

A series of views taken or captured using the techniques shown in Fig. 4 or Rg. 5 can be used to 
generate depth images using lenticular techniques as described in the related applications. If the angie a^ 
and angle 32 (Fig. 5) are small between individual views, then the views 50 and 70. 54 and 72 and 58 and 

10 74 will, to the human viewer, give a virtually identical sense of depth. The statement if angle ai and angle 
32 is small, is simply a statement that Zi is greater than the displacement distances Xi and X2 between 
views. If Zi is of the same order or is less than the displacement distance t)etween views, the viewer will 
develop a sense that the image is being rotated before him and while not identical to the other technique, 
will still achieve a strong sense of depth and additionally, ai and 82 will be larger. 

75 We have, to this point, considered the on-axis orientation of the viewing configuraton/: Now^^^^ 

consider the scene as a whole. Any given view 90, as illustrated in Fig. 6, will have a point 9^ it 
corresponding to the position of the perspective axis for that view. The perspective axis is^th«;Jine?i^ 
through the arbitrary (as determined by the photographer) centerpoint of the scene fieki and its oewresporid- 
ing location at the center of the imager focal plane. That is. the perspective axis is a line in space nornrtai to 

20 the taking camera image recording plane and passing through the rnaar nodlal point <^- tto^^^t^ 

lens system for any given perspective view of a depth image. A p>erspecj^ view ^i : one;,d^^^ of 

images of a given scene used to generate a depth image. The taldng carr^era position, rela^ 

is progressively changed with respect to rotation atxjut the taking lens re^ar ripdal p^ 

in mathematically predictable incremental steps from an extreme left position to an extreme right po^^ 

25 a plane nominally intended to include a human's eyes when viewing the same scerie. For . simp][iCT^ 

assume, though this is not necessarily the case, that point 92 is at the centw of the^^^^;^^^^ 6. 
The edges 98 and 1 00 of the view to the left and right, will t>e displaced an arigleVtodeith^r^^^d^^ 00- 
axis point 92 forming a subtended angle bi for the entire view. Let us assunrie also, that Jbf ;!^^ 
(Fig. 5) and therefore within each view, whether the view is taken or captured under coriditii^ in 

30 Rg. 4 or Fig. 5, the same information appears in the central area or at least; across the area'Jaub^ 
bi - ai, as shown by dashed lines 94 and 96. Thus, provided the angle bi is large enougjjife^^ 
whole field of interest of the scene, then ttere is the same information in both Rg. 4 arKJ I^^ 
conditions. 

Furthermore, the data collected in Rg. 4 and the data coIlectecf;;in .Rg. 5 can be mad(B;equiw|*&iMt^r^^ 
35 by moving the central perspective axis arxj compensating for rotational magrvfication cheuigfe::f-pf:4 

if pictures had been captured with a camera perspective geonrtegy-as^ sh 4 af]d:lt is|dSsSratte,to 

deterrhroe how thie view^ would^:lo6k ais if ^the carhiera per^pec^r^^ 

point zi defining the location of the desired rotational point the 
dimensions x1 and x2 (of Fig. 4) to calculate angles ai and a2 (qf Rg- 5), respectively, SioOTyma^^ focal 

4o planes 70. 72. and 74 are respectively perpendicular to perspectiye axis 78, 80. arKl 82, tiii^ 
planes also represent angular rotations equivalent to the rotations of ttie perspective axj9s;a?jfJ-4te 
of picture elements lying on these focal planes, as shown in Rg. 4, can be convert^ to /!pca^i«^^l^^ 
woukj appear at in Fig. 5 by trigonometric calculations. This techniciue ensures that forr arty giv^ 
situation, one view remains identical and unchanged after transfofmatkxi as represented by 56 artd 72^ <^ 

45 Rg. 4 and 5 respectively, and other views such as 50 and 58^^BGp^ 
respectively- Thus, by the method of displs^ing the path and ,pfd\^€NS^^^^^ 
data can.be collected in every , situate should be nptic»d;,tt^ 
Second order effects do in fact (>ccur dues 

possible lens distortion), but these, warpages can also be compeifisated for^^^^ 
50 these secprKi order effects are not signific^rjt is tha^ 

The cbh^uehces of providing tp^thS^€^^^of |^ 

opposed to Rg. 4 can be seen by comparirig Rg:'2.with;ff^^ 

and 18 between viewpoints 1 arid:? when the images are takertjjs^ 

of Rg. 4. As pf viously discussed the jumip or displacement ■ of ?^^5iei^^^^^ 
55 relative jump or displacement is also large. Rg. 7 illustrates the sarnie; scerte captured usir^ t^^ 

perspective axis techniqu of Fig. 5. As can be seen the displacem^t d!stah6e dfe v£rf-ot^^ 

much greater than the displacement distance db in. Rg. 7. That ■is. fiievj^ 

object 16 when displacement distanc s di and d* are compared. The images of Rg; 7 take^ 
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the image plane about an arbitrary point 100 located between objects 16 and 18. If one of the objects is 
used as the rotation or perspective axis convergence point 100 the jump of that object will be zero but the 
image will rotate and the jump of the other object will increase. The reduction in jump wilt be maintained 
when the images are captured using the convergent perspective axis method of Fig. 5 or Fig. 7 and is 
5 printed as a lenticular print. The print will exhibit keystoning. which is an appearance of object rotation, but 
this is generally an effect that is expected when a user moves his head when viewing a real scene. 

An image capture system in which the image perspective axes converge to an arbitrary. point or a point 
of interest will reduce the amount of jump in the lenticular photograph as demonstrated above. Such a 
system can be constructed by a person of ordinary skill in the art by fixing the convergence point of a 
10 multi-aperture camera and angling the film within the camera to be perpendicular to the lens axis. A 
professional system could be constructed by those of ordinary skill in the art to provide a jig with angular 
positioning harnesses for several cameras, such that the cameras could be set to point at a single 
convergence point. Conventional swing back cameras could also be used such that the swing back holding 
the film is oriented perpendicular to the line to the convergence point. This point coukj be the object of 
T5 interest within the scene or an arbitrary point an6 could be selected by the photographer. 

As illustrated by the process of Fig. 8 the images would first be captured 102 using the convergent 
perspective axis camera setups discussed above. The captured images are then processed 103. using the 
techniques described in the related Taylor et aL. Fogel and Manico applications previously mentioned, to 
produce 104 lenticular photographs with reduced jump. 
20 However, it is sometimes difficult to predict at the time of photographing an object scene exactly what 
convergent point will create the most effective depth print Alternately, as illustrated in Fig. 9 if the images 
are captured 105 using the parallel perspective axis technique of Fig. 4. the views 50. 54 and ,58 can be 
processed by a computer, such as mentioned previously, and converted 106 into views 70, 72 and 74:;with 
convergent perspective axes by shifting the path and, if desired, performing the second order magnification 
25 corrections previously discussed. The transformation can be performed using equations set forth>in Applied 
Photographic Optics by Ray. Focal Press London, pgs. 448-450 (1988) incorporated by reference herein. 

Once the transformed images are obtained the processes discussed in the related applications can be 
performed 107 to produce 108 a lenticular photograph. If additional views are created between the original 
captured views or the converted views, by interpolation as described in the related Taylor and Fogel 
30 applications, it would be preferable to adjust the perspective axis of each of the created views to point at 
the same convergence point. 

Now let us return to the consequences of the convergence perspective idea on :^ display such as a 
depth image print. As shown in Fig. 10. a display of a depth image from a planar surfacerll P.; such as a 
photograph or CRT display, can be considered as a number of views -having principte display axes at 
35 different positions and the same angle, or at different angles. In a depth image, a line drawn frorn the center 
of a recorded image segment to the rear nodal point of a lenticule or lenslet prpi^tir>g,v^t image is 
refracted at the lenticufe-air surface to a new line by an amount deterrnined by Snell's law. Thaa:|iew Hto^^^^ 
the principle display axis for that recorded image segment. If the depth image is of the lenticular type 
having extended cylindrical optical surfaces, the set of lines drawn from the center of a recorded image 
40 segment line will describe a plane, as will the set of refracted lines. Therefore, the display axis angle must 
be measured in a plane nomial to the axes of the lenticules. Thus, in Fig. 10 there are three views 1 12, 114 
and 116 each with a perspective axis pointing to the same position 118 and for simplicity we^will assunrie 
they are symmetrical, that is. angle ci equals angle ca. The central perspective display view 114 need not 
be normal or perpendicular to the planar surface 110 of the display but is shown as such for simplification. 
45 The central perspective display view is the: perspective view of a depth image that .is yisibte,.^ one eye of 
an observer at the middle of the angular display range. The^princ^We di^ptey 
perpendicular to the surface 1 10/such :#;jKis.jl1>4^ 
shown tjy 112 and 116: In preferred:depifM'fma^ 

but three views will be considered for simplicity in this discussion, JHie^ p^ 
50 116 correspond to the three views or viewpoints 118. I20^an^-1^; o 
viewpoint will emanate from other positioffe on.the surfac^^^i^^ 

correspond to rays which may or may not be parallel to any of th axes. Thus, fpr;exan?ple 
shown in Fig. 10. the principle display axes for the thr^^ yiews or^view^ 118, .l^^^ 

produce other optical rays. ; A 

55 For example, as illustrated in Fig. 11. view 1 with principle display axis 112. also has rays 130 and 132 
converging at a vi wpoint 134 emanating from different .positions along the depth 
principle display axis \V4 with rays 140 manating frorn ppim^42 an^ ray 144 emfflT^tng; 
and converging on point 148. Similarly, view 3 converges on point 150 using ray 152 :from point 142 and 
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ray 154 from point 146. Notice that the viewpoints 134, 148. and 150 need not be co-planar. The points 142 
and 146 are displaced distances X3 and x* respectively from the point 118. View 1 is responsible for and 
includes rays 130. 112 and 132. view 2 for rays 140. 1 14 and 144, and view 3 for 152, 116 and 154 and the 
rays at each view are combined by the eye into the complete scene. Points 134, 148 and 150 may or may 
not be co-planar. 

When a viewer views a scene, the viewer may in fact assume that he is viewing it under the same 
taking conditions as shown in Fig. 4. This is illustrated diagrammatically in Fig. 12 where scene 170 is in 
fact viewed by the viewer at a series of in positions 172-182 along line 184. Constraining the viewer to view 
the scene in line 184 is a good first order approximation of looking around a subject centered at the center 
of the arc 190 since the eye/brain accommodates for or corrects for such nrK)vement with amazing facility. 
For example, when a viewer moves across a room where things are constantly changing in size, as defined 
by subtended angle, the viewer knows that the size is conrect because the eye/brain corrects for the 
changes. Similarly, based on the available seeing clues similar eonrective operations take place in terms of 
size and subtended angle when a depth image, such as a lenticular photograph, is viewed by a viewier and. 
thus, second order effects such as magnification warpage and distorlibh are not as serious as tHey m^iy firsrt 
appear to be, 

Altematively. as also illustrated in Fig. 12. we may model that the viewer is viewing the scene along a 
line 190 which is not straight, for example, at viewing k>cations 192-198. These viewing positions are also 
satisfactory to a viewer. They may correspond to the viewer walking arournj the scene or the scene rotating 
in front of the viewer. Either situation (line 184 or 190) appears to contain enough information and does not 
introduce too great a distortion for the viewer to mentally develop a depth or three dimensiorial comprehen- 
sion of the scene. It is. however, also possible that when reprcKkKung a seme, for exanntple a in Fig. 13, 
where the scene is a planar scene contained in plane 210 with a series of views as described; with respect 
to Fig. 11. but with a shallow arc, that the views correspond, for exsimple.^ 
views 172-182 l>ut may not be contained in the straight Hne l 8#^j[Bg? !l 2) ti^ 

(Fig. 13). This distortion of the scene lir>e again, provided it a is- ;m6def ca^ises^y. 
great k)ss of fidelity in mind of the viewer. Similarly, the view ialongvkifeSi^^ 
reproduced along some other curvature or may be reproduced aksfig a st^ 

fidelity. Thus the designer of a three dimensional or depth imaging system has the freedonn of asserr>&Kng 
the images along some line of view and to a first order mjay then rejp>m^ 

along a different line of view without any great loss of fidelity. " , \ if-' 

Given that this freedom exists, the optimal criteria the designer of a three dimensiorial systen^ 
take advantage of to produce the most faithful reproduction of a Uir<^ dirnensional scene will rjbi^^l^^lther 
discussed below. One criterion, as fw-eviously discussed, and etatx^ate^^^ o^ is the angle betwoe^ th^ 
persF>ective axes used to capture the images and the principle display axis used to reproduce tKe?imi^ 
Another is optimal angular resolution to minimize »"^g© iyinriF^ discussed ^ijriV^^ 

tetowi^ln most three dirnensional viewing systems, as ah^dylref^hr^ 
is generated through assembling a set of views normally dispiaCt^nn^^himzd^ 
be disjplaced also in a vertical direction where exactly the same cx^ndliti^s; as^ a^ 

the viewer views across the scene, the viewer is in fact seeing a variety of views which enable the viewer to 
mentally assemble a three dimensional model of the scene that ^is being reprocS^jced. There 'are: av^v^ 
different clues for three dimensions. One is, of course, the viewing of different .vcaws seen by^ the-^twd^^yes. 
This requires only two views but generally requires either glas^^.or appr^^ 

the directions of the two views. Another approach (and this i§ the;:apprb^r^ i§%li^S a rnuh^ 

of vievifs, so that at a particular head pK>sition each eye sees? a^difbrc^t viWbut<^ ti^$^ 
scene appears tp smoothly change from one: view to 1J^^ 
change in a vcx)ordinated 
requires ia l&#^iirii^ 

scene. Inriage jurhp is a noticeable image shift that ia vieJwei^^ 
another. This junnpiness. of course, will be rnost visible, at^or b)r^^^ 
e<^^0f^^|tf^i|^^ and are sightficantfy^ 

wiirt)e :rnost ot>vious: Clearly an important aspect of the^eaifiS^ 
One way to minimize jump is to minimize the shift in alignmjef]rt^<^ 

view. ■ " . ■ ' ' -<:^^^--.~- '^^^ ■ 

One approach to minimizing this shift in alignment, is to make all views thersame,ihis r^tts.-in {^ 
alignment and zero jump and corresponds to an image without depth inforrhatiSit/ viewer sees 4»© 

sarhe thing from every view and there is no additional information frdrn brie vi^^ ■ --.T^'f^^^y'' 
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Another approach is to minimize the displacement between views. This corresponds to either Fig. 4 or 
Fig. 5 in making the distances xi and X2 and the angles ai and 32 small. In fact, the displacements, xi and 
X2 or angles ai and B2 may be reduced, so that when the equivalent views are seen in the viewing situation 
(Figs. 11-13) the actual displacement of object edges from view to view, is less than would actually occur if 
the viewer is seeing the whole original scene. In other words, the eye/brain combination is able to 
reconstruct a three dimensional scene with less scene displacement than is in the actual scene. This 
reduces image jump and improves the fidelity of the image. 

Although it is obvious that object edge displacement is proportional to viewing distance, it can be very 
easily reproduced geometrically by considering the elementary scene shown in Fig. 14. Fig. 14 shows a 
plan view of a scene which includes three vertical poles 240, 242 and 244 aligned in a row. Assume that the 
scene is viewed at three positions 250, 248 and 252 rotating around point 246 a distance Z from the taking 
lens of the central view 248. For simplicity of mathematics, it will be assumed that the point 246. is co- 
planar with the vertical poles, 240, 242 and 244. It will be readily appreciated, however, the principles 
discussed herein apply even if the simplifying addition of the point being co-planar with poles does not 
apply. At view 248. the viewer sees a single pole 240 because poles 242 and 244 are hidden behind and 
occluded by the pole 240. Assume that all poles 240. 242, and 243 are the same height, and that the lens 
at position 248 is positioned vertically below the top of the pole 240 and above txrttom of the pole 240. so 
that only a single pole 240 is viewed at position 248. At position 250, three poles are viewed, with pole 244 
being the left most and 240 being the right most. Assuming pole 240 is a distance 2i from the lens 
positioned at 248, 242 is a distance Z2 from the lens 248 and 244 is distance Za from the lens 248 and 
assuming the displacement angle is a. then in the scene the apparent angular distance (AAD) between pole 
240 and 242 is given exactly by the equation (1). 

AAD = arctan(Z2-Z(l - cos a))/Z sin a- 

arctan(Z^ -Z(l-cos a))/Z sin a (D 

If we now use the relationship: - 
tan(A-B) = (tan A - tan B)/(1 + tan A tan B) (2) 
then equation (1) simplifies to: 

AAD = arctan ((Z2-Zi) Z sin al(7^s\vr^a + (Zi-Z (1-cos a) (Z2-Z(1-cos a))) (3) 

if we further assume that cosine a is approximately equal to one then we.get a simplified ^uatiw f^^^ 
a: 

AAD = arctan ((22-Zi) Z sin a/ZiZ2) (4) 

If we further assume that sin a is approximately equal to a because a is sirriall. we get: 
AAD = arctan ((Z2-Zi)Za/ZiZ2) (5) 

This shows that the displacement from one field of view to the next is sn^all when^the ar^ 
and Zi are ctose to each other. Thus, the jurnp^can be^^egu^^ 
things in addition to or alternatively with those^tiisriihodfs 

the distances xi and X2 can be accomplished using to one of ^ftfb^ap^^ Eifter im^MSing^the =nurnte^ 

of views over a total viewing angle of the scene, or by recfucing as we h^ve alrfac|yv.d^^^ 

subtended viewing angle a in the scene to be less than tl^^^ 

viewed in addition to or alternatively with those methods :i?re^>fldusly ;<fec^^ 

reduc the differerice between Zi and Z2. This means redudng ^the amp*^ 

ratio of the total viewing distance. This conresponds to hayin^;:vBii^,dimer)s^ 

depth within the scene which is limited. This is very similar to' th constraint on d^pth^if fbcu wtiere focus 
is on a certain point birt the available range of focus is Umiited^B^in 3^ 

known to serious phbtpgraphers. They devetop techniques ;fot:Jci^ th#u:,camfra 
has a small depth of focus, everything of interest Is within focus. This is used, for example, in portrait 
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photos. 3, The third technique is to increase 2t and Z2 by a significant amount, for example, increasing Zi 
and Z2 by the original value Z. This corresponds to being well back from the scene which is being taken. 
Thus we have identified four techniques, in addition to those previously described, two of which revolve 
around reducing the value of a. one reducing the difference between Zi and Z2 and the fourth one which 

5 reduces the absolute ratio of Zi/Z and Z2/Z. 

The first technique for reducing the angle a or the distances Z^ and Z2 involves Increasing the number 
of views or images reproduced In the final lenticular photograph. This is graphically Illustrated in . IFig. ;15 and 
the process is illustrated in Fig. 16. In a first stage 260 the physical images 264, 266 and 268 are captured 
262 using a convergent perspective axis camera system (Fig. 5) or the images are captured using a parallel 

70 perspective axis system (Fig. 4). The parallel axis images can be converted into a convergent perspective 
axis images as previously discussed, tt is preferred, but not necessary, that convergent perspective axis 
images be produced for processing in the succeeding steps. In a second stage 270: M intermediate Jm^^ 
are interpolated 272 as discussed in the related Taylor and Fogel applications. The ^rsf^^ye.:^^ 
interpolated image is rotated to converge, if convergent axis images are used, as pf evipui5|y ,d^^ 

75 a lenticular photograph is printed 274 as descrit>ed in the relateti apjbHcM^ 

viewer (typically a development lab technician) looks at the photograph and judges 278^^^^ 
jump is reduced to a satisfactory, value. If not the number of jrn^^es -created by interpblatidn'is^^^ 
277. by some value N. The number can easily be determin€Nil<ex^rime^ for various lentictilarAj^ 
designs. Then, the greater number of images are created.and printed in stage 278. Note th^ the ac^al 

20 views appear in the set of views of stage 278. This cycle of increasing the number of imag^s^can: conttnt^ 
until the maximum resolution is reached, that is, when each line: image urider a tehticuter is a :sii^ 
pixel wide. Alternately the number of images can be increased until the resplutic^ ol ;^eac^ 
some unsatisfactory appearance or still further the maximum numtjer of vi^ws Can aa^^tia^ - 
some value such as 12 or 24. If such an arbitrary value is chosen the first stage 270 ran 'c^e^te 

25 maximum numt>er of views. When a typical camera, such as tt^t^u^ed tri^^^^^^ 
which produces several original images, at least 12 total imag^S;^ 
interpolated images is sufficient to reduce jump to ian ^tbcei^ 
preferred printer arKi a lenticular cover sheet with apprpximkttei$^^ 

24 views. If a technique such as descrit>ed in the related Ma^^^^^ stiti targ^r^n^ 

30 views is possible. Of course as printer and lenticular technoto^ifs^y^ hurrib^/ \^ev^ utkter; 

each lenticule will t>e possible limited by the resolution of the r<^cbrdmgrm^^ '''■■'^■'^--■V' ; 

In another approach which enhances depth resolutipri for e2u!;h eye ire(|ii&&s 

the possible viewing positions, the interpolated numtjer of imiages produced in step 270 c^^^ b^^ 

two sets each with a pair of refererK^e views 282, 284 and 286. 288^^ach set of viewsf; coitespo^^ 
35 of the eyes of the person to view the final image. The views|aw, 2§6 and>i^ 

then created between the respective pairs and the created views are used to create ttie depth irftage wiili 

one hatf of the views in the final image for one eye and the other h£^ for the ,otheri^ye;. a^^^^ 

discussed. ■ ' ■ 

The second technique for reducing the angle a or the distances xi and X2 is graphically ilkistrated in 
40 Fig, 17 arKl the process performed is illustrated in Fig. 18. In this metirod as in the previous mMhpdjfma^CKS 

are captured 288. The images, if captured using the parallel perspective axis approach (Rg. 4) are 

preferably converted into convergent persfjective axis images 290, 1292, 294, and 296. although i::^^ 

is not necessary. Conversion if performed should fcje performed iminediatBly prior to print file cbnstrxiction. 

In a first stage 298 the captured views are interpolated 3€K). usir^ the captured views 290 mdl^4;^a^^: 
45 reference views between which interpolation is perform^d.^/^^ 

pr viousty discussed, with the original views appesu-ingvirt trt^i^J^ 

prwipusi^apprQa^ the tentipuiar p 

refeirehcei^\rtews are ^tec*Si vvtVich^ 

between views^ if a convergent axis system is uised. dr^^^^^^^ 
50 views, if a parallel axis system is used. For example, if tiie/^distarice't^e^ 

reduc^'^frdm- one inch ■ ap^ m 4/4 • inch ap^^tifiis' "^^^^^^^^^^^S^^^^^^^^^^^^^^^^' 

and the cprrespdTKling reference vtevys can be^lected.:by a^^^ 

someVseli^ction criteria based on factors v associated v"tii Igie^^^fl^^ 

poster or; point of sale diisplay ^will impose different ;.cqr^ 
55 views can be the original captured, views if several origin^ vvie^ 

images as shown in Rg. 15 or a a>ix of captured and interpolated^vie^r^^T^ 

another cycle of interpolation 300 artd judgement 304. The cijtSte^eM^ 

produced or the limits pr vtously discussed are reached. Of course, it is possible :tb aiftomaticalJty rec^^ 
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the subtended angle to some value such as approximately 1.0 degree whenever a photograph is found to 
be unsatisfactory rather than going through several cycles of print judgement- A typical scene, which might 
include objects ranging from 3 to 10 feet captured using the Nimslo camera mentioned previously has a 
displacement of 3/4 inches degrees between captured views and a subtended displacement of 1/4 degree. 
When 3 views are created by interpolation between captured views this will substantially reduce the image 
jump in the typical lenticular photograph and thus 1/4 degree is an appropriate angle by which to 
automatically reduce the subtended view. As a guideline the maximum displacement between views is 
governed by the convergence angle of the eyes looking at the scene. 

The subtended viewing angle reduction operation can also be performed for each eye. so that each eye 
sees a different set of images. In this operation, two sets of views on either side of a center view can be 
chosen each with a pair of reference views 310. 312 and 314. 316 as shown in Fig. 17. The views between 
views 290 and 310, 312 and 314 and 316 and 294 are discarded. The pairs of reference views are used to 
interpolate new views where one half of the created new views are for one eye and the other half are for the 
other eye. The interpolated views are then used to create the depth image. Of course one or more of the 
15 reference views can t>e the original views if desired. 

The techniques for reducing the difference between Zi and Z2 or reducir^ the actual value of Zv and 
Z2 will now be discussed. However, first we need to illustrate what happens when the viewed perspective 
axis and the captured perspective axis are different for the same view (image). The orientation of me 
perspective axis along which a scene lies when captured need not correspond to the orientation of the path 
20 along which the scene lies when viewed. Changing the path along which scenes are viewed as compared to 
when captured does not change, to a first approximation, the local content of the scene as can be seen 
from equations 4 and 5 because both those equations are relatively unaffected by an increased Z because 
to a first approximation, doubling will half "a", therefore, keeping the perceived angle relatively constant. 
That is to say, Z can be varied in consecutive views, thereby changing the path wit*K>ut appreciably 
25 changing the angles t)etween the poles. . . ^ ^..^i. . : 

The viewing angle difference to a first order is simply a function of the difference in depth between tt^ 
views for an on-axis situation. The equations for off axis situations are the same. The^^seeond order effea$. 
depending on scene configuration, can be corrected by conventional warping within one view or by view^ 

view warping. ^ 
Note however, that the difference in angle between the views is not the only reason for the sourceAOf 
image jump. The other reason is that the rotation is around a point greatly separated in deptii details of 
interest- Consider for example, the configuration shown in Fig. 19. where a single pole is observed vocally 
and the capture condition shown in Rg. 4 is reproduced then clearly although there Js only one pole, me 
angle between mat pole from view to view will be defined as.Qfa/Z*). In me general case, related to Rg> 14. 
35 to minimize the jump angle for any given pole, it is only necessary to ensure that me rotation is around that 

pole. . ' : 

Geometrically mis means that arthough me taking condition may be taken parallel wim pierspective^s 
of me camera or lens (moving along a straight track), the display condition minimizes jump if me 
perspective axis of me views are radii of a circle centered on me detail of me picture. (As in mis example, a 
40 pole which is me point of detail). Of course, mis works best when me picture has one area of detail. Other 
perspective axis focal points are more optimal, when the area of detail of the picture is a region and the 
shape of region is identified through processing various captufi^ images, such as between me areas of 

detail. "^'W' '^-/^'x^ 

The next question is how is me geometrical relationship between me perspectiveij^es/^ modifi^^^ 

45 ensure that it is optimal for all situations. Clearly a photographer requires ^ siM^ 

pictures without me complexity of changing the geometry of the camerav To overc^^ 

changing the geomeby 6f me camera, by ;iarioywng^t^^ 

modify me perspective axis of me im^^s t6^^viar#^w^^ aws::tn the ease^ 

sequential images along a track by nrnxJifying me tn^^br^ 
50 curvature, the perspective axis of me images can te^alt^^^^y.OT 
between images in the scene. Relativ displacement s 

by a system wher me images are electronically processed wim a computer prior to pnotrng^or.^lfsp^^ 
electronically shifting the image. ^ v ^ ^ y v^ ^ 

Figure 20 is a block diagram of a memod to process images to. minimize ima©e iump.and ther^ 
55 improve image quality in mree dimensional or depm images. The method may be fully el^onic or use 
film and scanning electronics. A cam ra which takes pictur s wim film and has four in-line lenses such as 
me Nimslo camera can be used to tak 340 four perspective viewis. 
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The roll of film is then developed and sequentially scanned in a scanner comprising a lens and a CCD 
to complete the capture 340 of the images. The images are then processed to identify 342 the X-Y 
locations of edges, in each image, for regions having a considerable density of edges across the scene 
using a conventional edge identification process such as discussed in A Threshold Circuit For Converting a 
Video Signal to a Binary Video Signal, R.R.A. Morton, U.S. Pat. No. 3,763,357, and Methods of and 
Apparatus for Determining the Quantity and Physical Parameters of Objects. R.R.A. Morton, U.S. Pat. No. 
3,805i028. both incorporated by reference herein, where X is a horizontal location of an edge in each image 
and Y is a vertical location. These X-Y coordinates are used by a process as described in the related 
application by Fogel to determine 344 the Z locations of the areas of the edges of high detail (more 
specifically, details whose structure or sharpness is greater than the shift between consecutive views). A 
three dimensional map of the regions of high detail is then constructed 346 from the Z locations to identify 
the location of the high detail regions within the three-dimensional space captured by the cannera system. 
This identification is performed by high pass filtering both two dimensional views to identify correspor>d6nce 
in each view. Having identified the regions of high detail in the image, the next step 348 is to angulariy 
move the image in the X direction, so that the radius of the perspective axis of viewir^ rotates around the 
region of high detail 390. This is achieved as shown in Fig. 21 . which shows the plan view of taking and 
effective viewing positions, by providing a linear angular shift. S, : in each view 360 with respect to a 
reference view 364 given by the amount in equation 6. 

S = Arctan (Za-Zb)*sin a / (Za(Za-Zb)'cos a) (6) 

where Za is the radius of the taking path in the original image. Zt, the radiu^ of the view^ the 

desired image and a is ttie displacement of any given view 362 which is being c^rre^ 

view 360 by its relationship to the reference view 364. This shift moves the position of each pixel in the 

image in the x direction by the angular amount S limited by the width iof Afield of vie^^^^ 

images. The reference view 364 is defined as the view against which, tt>e lotion, of are 

referenced. It is normally a view towards the center of the scene. The fentkjular print^^^i^ then prpdtrced 350 

using the interpolation techniques previously described with respect ;to one^ V^^ region of 

the highest detail, which has been minimized prior to interpolation processing. This should produce the 

same conditions as shown in Figure 21 with the exception that: every, taldng^^^>^^ 

equivalent viewing position (meaning that is taking views 380 and 381 wcHiikj have to be incHudecO- -ri 

Another method that can be used to achieve the desired result <^ mintrnal stutter is to: scan the views 
on the film using a conventional scanner 420 (Fig. 22); store 430 (Rg. 23) the resultir^g views in a 
conventional framestone 422, which is controlled by computer 422:;t6 pro 
display them on the workstatiori, such as a Sun Sparc 2 with 32 rhb RAM an^^^^^^^^^ 

432 and 434 an arbitrarily chosen point in a scene (usually a point which has the highest interest); and edit 
436. 438 and 440 each vtew.to shift the image components in tf^'KcfizorHai^^^ 

point in each view are coincident, and consequently the scene rotates arourKf that point; Sub»sequentty the 
edited images are combir^ and printed 442 by printer 426. 

A manual method of selectively blurring the image, which will also reduce, stutter, is detsaled t^ebw. 
This method involves running application software (such as the Kodak Premier System wrih image 
sequential alternatir>g capability) which allows the blurring of the image as a function of depth frcvn the pivot 
point in the viewing condition by executing the following steps and nrianually using the aittemating capability: 

1 . Advance across reference image on a regular pattern. 

2. In each region (eg. background, middle ground/ foregri>6r^^ 
views by observing the shift t>etween each view in thi^regipn^ 
pairs of consecutive views. For each: region the amo^^^ 

''r€kiUiVed/'RetCirhvfl^''^dKs(hm^ -• ..^.^^^^-^hi^iiS^ -r^^^^-'--/*^ •\- 

3; Air brush the same region in each view using the same diannielBir ieur bm^ 
4. Move- on;to the next region, rep^^ x - - r • . ^ Z.^^, / 

Ih tf^- dis^u^ip^ 
th s shifts need to be transilatectintoi^^ 

plane) by which particular pixbl mijst l>e fr^^ a view has witfth W,^fi|fe 
across its width, then the relationship to translate angular shift s to p^^ic&;=sfS|l(f^ 

Distance = Ws/i 

The many features and advantag s of the invention are apparent from the detailed specification and 
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thus it is intended by the appended claims to cover all such features and advantages of the invention which 
fall within the true spirit and scope of the invention. Further, since numerous modifications and changes will 
readily occur to those skilled In the art. it is not desired to limit the invention to the exact construction and 
operation illustrated and described, and accordingly all suitable modifications and equivalents may be 
resorted to, falling within the scope of the invention. 
The invention may be summarized as follows: 

1 . A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene using convergent perspective axis imagers; and 

(b) creating the depth image from the captured views. 

2. A method wherein the image is a lenticular photograph. 

3. A method further comprising creating views between the captured views by interpolation. 

4. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene using parallel perspective axis imagers; 

(b) converting the views into convergent perspective axis views; and 

(c) creating the depth image from the captured views. 

5. A method wherein the image is a lenticular photograph. 

6. A method of producing a depth image comprising the steps of: 

(a) capturing views of a scene having actual visual displacements therebetween: 

(b) creating views from the captured views with created visual displacements therebetween less than 
the actual visual displacements; and 

(c) creating the depth image from the created view. 

7. A method wherein the image is lenticular photograph. 

8. A method wherein step (b) includes creating a pair of created views for each eye. 

9. A method of producing a depth image» comprising: 

(a) capturing a view of a scene having actual visual displacements therebetween; 

(b) creating views from and between the captured views using interpolation where the created views 
and captured views have created visual displacements therebetween less than the actual visual 
displacements; and 

(c) creating the depth image from the created views. 

10. A method wherein the image is a lenticular photograph. 

11. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene with actual visual displacements therebetween; 

(b) creating a created view between the captured views by interpolation where the created view and 
one of the captured views have a created visual displacement therebetween smalter than, the actual 
visual displacement; ■ 

(c) creating interpolated views between the one of the captured views and the created view by 
interpolation; and 

(d) creating the depth image from the interpolated views. 

12. A method wherein the image is a lenticular photograph. 

13. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene with actual visual displacements therebetween; 

(b) creating created views between the captured views by interpolation where the created views have 
a created visual displacement theret>etween smaller than the actual visual displacement; 

(c) creating interpolated views between the created views by interpolation; and 

(d) creating the depth image from 1^^^^ 

14. A method wherein the image is a iS^tic^ ' 

15. A n^thocL^here^ 

1 6. A rTieift6a^6f|l^^^ ima^ef ci^^ 

<a) capturing views of a scene w axis; 
(b) modifying the perspective axis of the vi€|ws; ar^^ ^ 

(e) creatihgi th^ ctepth W 

17. A method wherein the image is a lenticular photograph. : . :. ^ . 

18. A method of producing a depth image, comprising vthe. steps of: ^ ■ ^ 

(a) capturing views of a scene with persjpective axfs^^ ' 

(b) identifying a volume in the scene with the greatest number of image edg s; 

(c) shifting the perspective axis of the views to rotaite around the volume; and 

(d) creating the depth irriage from the shifted per^^p^ctive axis views. 

19. A method of producing a depth image, comprising the steps of: 
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(a) capturing views of a scene; 

(b) identifying areas of highest detail in each view; 

(c) correlating the areas and determining displacement distances between the correlated areas; 

(d) determining a minimum displacement distance between views; 

(e) displacing each view the minimum displacement distance; and 

(f) creating the depth image for the displaced views, 

20. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scer>e; 

(b) identifying alignment points in each scene which correspond to a same scene point; 

(c) shifting each view to align the alignment points; and 

(d) creating the depth image from the shifted views. 

21. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene: 

(b) determining displacements between the views; 

(c) airbrushir^g stuttering objects in the views using the displacements as airbrushing diameters; and 

(d) creating the depth image from the airbrushed views. 

22. A depth image apparatus, comprising: 

a substrate including recorded images, the recorded images having a subterKled vtewir^ angle 
therebetween which reduces stutter to a visually non-distracting amount; and 

depth image display means confronting said substrate for producing a depth image from the 
recorded images. 

23- An apparatus for producing a depth image, comprising: 

first second and third image capture devices with image planes oriented to a convergent point arKi 
capturing convergent images; and 

means for producing a depth image from the eonvergemimiygpBS.^^^ - - ^ - - 

24. An apparatus for producing a depth image, comprising: ; , , .vvJ j . 

first, second and third image capture devices with image ^pl^arSes^c^^ irifinity 
producing non-convergent images; 

means for converting the non -convergent images to convergent images; arnj 

means for producing a depth image from the convergent images. 

Claims 

1. A method of producing a depth image, comprising the steps^iOf: v i=i v;^^ . 

(a) capturing views of a scene using convergent perspective iaxis Imagers; arKi 

(b) creating the depth image from the captured views. 

2. A method as recited in claim 1. wherein the image is a lenticutar photdgra^. 

3^ A method as recited in claim 1, further comprising creating views between the captured vieiws by 
interpolation. 

4. A method of producing a depth image, comprising the steps erf: , 

(a) capturing views of a scene using parallel perspective axis irru^ers; 

(b) converting the views into convergent perspective axis views; 

(c) creating the depth image from the captured views, 

arid wherein preferably the imiage. is a v i,i^:;.~:> ■r.:<^-^-^-^-z 

5u A method of producing a depth image comprising the steps of : , ; 

(a) capturing views of a scene having actual visual displaqernents therebetween; 

(b) creating views from the captured views: with created^Vi^^^ 

the actual^yi^yal displacements; : • 

(c) creating the depth image from the created view, , rW^-l ..f 

whereiin pr ferably the imag is lenticular phot6grapii«rl^r^;^^^ 
creating a pair of created vi ws for each eye. . ; . 

6. A met^lOd ofjxoducing a depth image^ w : ^:(i:y;:^^^^>^ ■ c^I . 

(a) capturing a view of a seen having actual visual displacements therebetween; 
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(b) creating views from and between the captured views using interpolation where the created views 
and captured views have created visual displacements therebetween less than the actual visual 
displacements; 

(c) creating the depth image from the created views. 

5 and wherein preferably the image is a lenticular photograph. 

7, A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene with actual visual displacements therebetween; 

(b) creating a created view between the captured views by interpolation where the created view and 
70 one of the captured views have a created visual displacement therebetween smaller than the actual 

visual displacement; 

<c) creating interpolated views between the one of the captured views and the created view by 
interpolation; 

(d) creating the depth image from the interpolated views. 

;5 and wherein preferably the image is a lenticular photograph. 

a A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene with actual visual displacements theret)etween; 

(b) creating created views between the captured views by interpolation where the created views have 
20 a created visual displacement therebetween smaller than the actual visual displacement; 

(c) creating interpolated views between the created views by interpolation; 

(d) creating the depth image from the interpolated views, 

wherein preferably the image is a lenticular photograph, and wherein preferably step (b) includes 
creating a pair of created views for each eye. 

25 

9. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene with perspective axis; 

(b) modifying the perspective axis of the views; and 

(c) creating the depth image from the modified perspective axis views, and wherein preferably the 
30 image is a lenticular photograph- 
ic. A method of producing a depth image, comprising the steps of: 

(a) capturing views of a scene with perspective axis; 

(b) identifying a volume in the scene with the greatest numt>er of image edges; 
35 (c) shifting the perspective axis of ttie views to rotate atf:oM»5«^ 

(d) creating tt>e depth image from the shifted perspective axis views. 

11. A method of producing a depth image, comprising the step^ of: 

(a) capturing views of a scene; 

(b) identifying areas of highest detail In each view; 

(c) correlating the areas and determining displacement distances between the correlated areas; 

(d) determining a minimum displacement distance between views; 

(e) displacing each view the minimum displacement distance; and 

(f) creating the depth image for the displaced views. 

12. A method of producing a depth image, comprising the steps of: 

(a) capturirrg views of a scef>e; 

(b) identifying alignment points in each scene which correspond to a same scene point, 

(c) shifting each view to align the alignment points; arid 

(d) creating the depth image from the shifted views. 

13. A method of producing a d pth image, comprising the steps of : 

(a) capturing views of a scene; 

(b) determining displacements t)etween the views; 

(c) airbrushing stuttering objects in the views using the displacements as airbrushing diameters; and 

(d) creating the depth imag from the airbrushed views. 
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4. A depth image apparatus, comprising: 

a substrate including recorded images, the recorded images havirjg a subtended viewing angle 
therebetween which reduces stutter to a visually non-distracting amount; and 

depth image display means confronting said substrate for producing a depth image from th 
recorded images. 

5. An apparatus for producing a depth image, comprising; 

first, second and third image capture devices with image planes oriented to a convergent point and 
capturing convergent images; and 

means for producing a depth image from the convergent images. 

6. An apparatus for producing a depth image, comprising: 

first, second and third image capture devices with image planes oriented in parallel toward infinity 
producing non-convergent images; 

means for converting the non-convergent images to convergent images: and 
means for producing a depth image from the convergent images. 
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@ Several different methods ak>ne or in combina- 
tion can l>e us^ct or stutter. 
Tfrk imageypitah^ original image is 
taken can t>e mechanically or electrontcally rotated 
at>out a point of rotation in the scene. The numtjer of 
original images which are viewed couki be increased 
by interpolation. Thet; subtended viewing angle of the 
viewpoints can be reduced and (fig-4.5) viewpoints 
within the subtertded viewing angle can be increased 
by interpolation. Itediiced angle 
innages can; l)e cre^dSeiJ for <^ach eye. The depth of 
focus of the ifT>aj^;^^^^^ by (fig.17) 
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images cHitside^ TfVB original 
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the images ^ii^^ 
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The highest de^^^wMnrw^^^ can be 
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identified arri the: Original irn^^ processed to dis- 



place the images to minimize the movement of the 
highest detail area. The (348) original images can be 
viewed and a point witttin each image iderrtified to 
align the point from view to view using a linear or 
other transformation. 
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